SET-MM – A Software Evaluation Technology Maturity Model

The application of software evaluation technologies in different research fields to verify and validate research is a key factor in the progressive evolution of those fields. Nowadays, however, to have a clear picture of the maturity of the technologies used in evaluations or to know which steps to follow in order to improve the maturity of such technologies is not easy. This paper describes a Software Evaluation Technology Maturity Model that can be used to assess software evaluation technologies in a research field. To illustrate the use of this model, we have employed it for assessing the maturity of software evaluation technologies in some evaluation initiatives within the semantic research field

Sustainability of Evaluations Presented in Research Publications

This position paper discusses how research publication would benefit of an infrastructure for evaluation entities that could be used to support documenting research efforts (e.g., in papers or blogs), analysing these efforts, and building upon them. As a concrete example in the domain of semantic technologies, the paper presents the SEALS Platform and discusses how such platform can promote research publication

Towards the improvement of the Semantic Web technology

The Semantic Web technology needs to be thoroughly evalu- ated for providing objective results and to attain a massive improvement in their quality in order to be consolidated in the industrial and in the academic world. This paper presents software benchmarking as a process to carry out over the SemanticWeb technology in order to improve it and to search for best practices. It also describes a software benchmarking methodology and provides recommendations for performing evaluations in benchmarking activities

Benchmarking Semantic Web Technology

This paper summarises the research problem that the PhD thesis I am currently writing addresses. It presents an overview of the thesis, its goals taking into account the deciencies of the State of the Art, the approach followed, and the work performed for the thesis since its beginning in 2004

Primeros pasos hacia un blog educativo

Los nuevos mecanismos colaborativos que proporciona la Web pueden dar soporte al aprendizaje de los alumnos de hoy en día. No obstante, es necesario definir con antelación el método de aprendizaje a seguir para que su uso sea efectivo. Este artículo trata sobre los pasos a seguir para definir un método de aprendizaje basado en blogs, a través del cual el profesor crea un blog para dar soporte a la impartición de una asignatura. Además, el artículo presenta un método de aprendizaje basado en blogs definido para una asignatura de grado a partir de los pasos propuestos

Benchmarking Semantic Web technology

Semantic Web technologies need to interchange ontologies for further use. Due to the heterogeneity in the knowledge representation formalisms of the different existing technologies, interoperability is a problem in the SemanticWeb and the limits of the interoperability of current technologies are yet unknown. A massive improvement of the interoperability of current SemanticWeb technologies, or of any other characteristic of these technologies, requires continuous evaluations that should be defined and conducted in consensus, using generic, reusable, freely-available, and affordable tools and methods. This thesis presents the following contributions to the field of benchmarking within Semantic Web technologies: It proposes a benchmarking methodology for Semantic Web technologies. It defines the UPM Framework for Benchmarking Interoperability, an evaluation infrastructure that includes all the resources (experiment definitions, benchmark suites and tools) needed for benchmarking the interoperability of Semantic Web technologies using RDF(S) and OWL as interchange languages. It describes two interoperability benchmarking activities carried out over Semantic Web technologies and provides detailed interoperability results of the tools that participated in them; the RDF(S) Interoperability Benchmarking that contemplates interoperability using RDF(S) as the interchange language, and the OWL Interoperability Benchmarking that contemplates interoperability using OWL as the interchange language. Las diferentes tecnologías de la Web Semántica necesitan intercambiar ontologías para su posterior utilización. La Web Semántica, por otro lado, tiene que hacer frente al problema de la interoperabilidad, que está causado, en gran medida, por la heterogeneidad de los formalismos de representación de conocimiento de las distintas tecnologías existentes, siendo la interoperabilidad en la Web Semántica un problema cuyos límites hoy se desconocen. Una mejora masiva de la interoperabilidad de las tecnologías actuales de la Web Semántica, o de cualquier otra característica de dichas tecnologías, requiere evaluaciones continuas, que sean definidas y realizadas en consenso, utilizando herramientas y métodos que sean genéricos, reutilizables, públicos y económicos. Esta tesis presenta las siguientes contribuciones al campo de benchmarking en las tecnologías de la Web Semántica: Propone una metodología de benchmarking para las tecnologías de la Web Semántica. Define el UPM Framework for Benchmarking Interoperability, una infraestructura de evaluación que incluye todos los recursos (definiciones de experimentos, conjuntos de pruebas y herramientas) necesarios para hacer benchmarking de la interoperabilidad de las tecnologías de la Web Semántica utilizando RDF(S) y OWL como lenguajes de intercambio. Describe dos actividades de benchmarking de las tecnologías de la Web Semántica y ofrece los resultados detallados de las herramientas que participaron en las mismas; el RDF(S) Interoperability Benchmarking, que contempla la interoperabilidad utilizando RDF(S) como lenguaje de intercambio, y el OWL Interoperability Benchmarking, que también contempla la interoperabilidad pero utiliza OWL como lenguaje de intercambio

Guidelines for the Specification and Design of Large-Scale Semantic Applications

This paper presents a set of guidelines to help software engineers with the specification and design of large-scale semantic applications by defining new processes for Requirements Engineering and Design for semantic applications. To facilitate its use to software engineers not experts in semantic technologies, several techniques are provided, namely, a characterization of large-scale semantic applications, common use cases that appear when developing this type of application, and a set of architectural patterns that can be used for modelling the architecture of semantic applications. The paper also presents an example of how these guidelines can be used and an evaluation of our contributions using the W3C Semantic Web use cases

Five Challenges for the Semantic Sensor Web

The combination of sensor networks with the Web, web services and database technologies, was named some years ago as the Sensor Web or the Sensor Internet. Most efforts in this area focused on the provision of platforms that could be used to build sensor-based applications more efficiently, considering some of the most important challenges in sensor-based data management and sensor network configuration. The introduction of semantics into these platforms provides the opportunity of going a step forward into the understanding, management and use of sensor-based data sources, and this is a topic being explored by ongoing initiatives. In this paper we go through some of the most relevant challenges of the current Sensor Web, and describe some ongoing work and open opportunities for the introduction of semantics in this context

Semantic Technology Recommendation Based on the Analytic Network Process

Semantic technologies have become widely adopted in recent years, and choosing the right technologies for the problems that users face is often a difficult task. This paper presents an application of the Analytic Network Process for the recommendation of semantic technologies, which is based on a quality model for semantic technologies. Instead of relying on expert-based comparisons of alternatives, the comparisons in our framework depend on real evaluation results. Furthermore, the recommendations in our framework derive from user quality requirements, which leads to better recommendations tailored to users’ needs. This paper also presents an algorithm for pairwise comparisons, which is based on user quality requirements and evaluation results

Extending Software Quality Models - A Sample In The Semantic Technologies Domain

In order to correctly evaluate semantic technologies,which have become widely adopted in recent years, we need to put evaluations under the scope of a unique software quality model.This paper presents a quality model for semantic technologies. First, some well-known software quality models are described,together with methods for extending them. Afterwards, a new method for extending quality models is proposed and it is then used to define a quality model for semantic technologies by extending the ISO 9126 quality model. Finally, the proposed model is validated by analyzing existing semantic technology evaluations